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Abstract — LDPC convolutional codes have been shown to be 
capable of achieving the same capacity-approaching performance 
as LDPC block codes with iterative message-passing decoding. 
In this paper, asymptotic methods are used to calculate a lower 
bound on the free distance for several ensembles of asymptotically 
good protograph-based LDPC convolutional codes. Further, we 
show that the free distance to constraint length ratio of the LDPC 
convolutional codes exceeds the minimum distance to block length 
ratio of corresponding LDPC block codes. 

L Introduction 

Along with turbo codes, low-density parity-check (LDPC) 
block codes form a class of codes which approach the (the- 
oretical) Shannon limit. LDPC codes were first introduced in 
the 1960s by Gallager [1]. However, they were considered 
impractical at that time and very little related work was done 
until Tanner provided a graphical interpretation of the parity- 
check matrix in 1981 [2]. More recently, in his Ph.D. Thesis, 
Wiberg revived interest in LDPC codes and further developed 
the relation between Tanner graphs and iterative decoding [3]. 

The convolutional counterpart of LDPC block codes was 
introduced in [4], and LDPC convolutional codes have been 
shown to have certain advantages compared to LDPC block 
codes of the same complexity [5], [6]. In this paper, we use 
ensembles of tail-biting LDPC convolutional codes derived 
from a protograph-based ensemble of LDPC block codes to 
obtain a lower bound on the free distance of unterminated, 
asymptotically good, periodically time- varying LDPC convo- 
lutional code ensembles, i.e., ensembles that have the property 
of free distance growing linearly with constraint length. 

In the process, we show that the minimum distances of 
ensembles of tail-biting LDPC convolutional codes (intro- 
duced in [7]) approach the free distance of an associated 
unterminated, periodically time-varying LDPC convolutional 
code ensemble as the block length of the tail-biting ensemble 
increases. We also show that, for protographs with regular 
degree distributions, the free distance bounds are consistent 
with those recently derived for regular LDPC convolutional 
code ensembles in [8] and [9]. Further, for protographs with 
irregular degree distributions, we obtain new free distance 
bounds that grow linearly with constraint length and whose 
free distance to constraint length ratio exceeds the minimum 
distance to block length ratio of the corresponding block 
codes. 

The paper is structured as follows. In Section [III we briefly 
introduce LDPC convolutional codes. Section [Till summarizes 
the technique proposed by Divsalar to analyze the asymptotic 



distance growth behavior of protograph-based LDPC block 
codes [10]. In Section HVl we describe the construction of tail- 
biting LDPC convolutional codes as well as the corresponding 
unterminated, periodically time-varying LDPC convolutional 
codes. We then show that the free distance of a periodically 
time- varying LDPC convolutional code is lower bounded by 
the minimum distance of the block code formed by terminating 
it as a tail-biting LDPC convolutional code. Finally, in Section 
IVl we present new results on the free distance of ensembles 
of LDPC convolutional codes based on protographs. 

II. LDPC CONVOLUTIONAL CODES 

We start with a brief definition of a rate R = h/c binary 
LDPC convolutional code C. (A more detailed description can 
be found in [4].) A code sequence ^[q^oo] satisfies the equation 
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is the parity-check matrix of the convolutional code C. The 
submatrices H^(t), i = 0, 1, • • • ,ms, t > 0, are binary 
{c — b) X c submatrices, given by 



H,(t) 



h, 



(c-M)(^) 
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that satisfy the following properties: 

1) Hi(t) = 0, i < and z > m^, V t. 

2) There is a t such that H^^(t) 7^ 0. 

3) Ho(t) ^ and has fuU rank V t. 

We call ms the syndrome former memory and = (^s + 1) • c 
the decoding constraint length. These parameters determine 
the width of the nonzero diagonal region of H[o,cx)]- The 
sparsity of the parity-check matrix is ensured by demanding 
that its rows have very low Hamming weight, i.e., wnO^i) « 
(ms + 1) • c, i > 0, where denotes the i-th row of H[o,oo]- 
The code is said to be regular if its parity-check matrix H[o,cx)] 
has exactly J ones in every column and, starting from row 
{c—b)ms-\-l,K ones in every row. The other entries are zeros. 



We refer to a code with these properties as an {m^^J^K)- 
regular LDPC convolutional code, and we note that, in general, 
the code is time- varying and has rate R = 1 — J/K. An 
(ms, J, iC) -regular time- varying LDPC convolutional code is 
periodic with period T if H^(t) is periodic, i.e., H^(t) = 
Hi(t + T),V i,t, and if Hi(t) = Hi,V i,t, the code is time- 
invariant. 

An LDPC convolutional code is called irregular if its row 
and column weights are not constant. The notion of degree 
distribution is used to characterize the variations of check and 
variable node degrees in the Tanner graph corresponding to 
an LDPC convolutional code. Optimized degree distributions 
have been used to design LDPC convolutional codes with good 
iterative decoding performance in the literature (see, e.g., [7], 
[11], [12], [13]), but no distance bounds for irregular LDPC 
convolutional code ensembles have been previously published. 

in. Protograph Weight Enumerators 

Suppose a given protograph has variable nodes and Uc 
check nodes. An ensemble of protograph-based LDPC block 
codes can be created by the copy-and-permute operation [14]. 
The Tanner graph obtained for one member of an ensemble 
created using this method is illustrated in Fig. [T] 




Fig. 1. The copy-and-permute operation for a protograph. 

The parity-check matrix H corresponding to the ensemble 
of protograph-based LDPC block codes can be obtained by 
replacing ones with N x N permutation matrices and zeros 
with X TV all zero matrices in the underlying protograph 
parity-check matrix P, where the permutation matrices are 
chosen randomly and independently. The protograph parity- 
check matrix P corresponding to the protograph given in 
Figure \T\ can be written as 

"110 0" 
P= 1 1 1 , 
1 1 1 oj ' 

where we note that, since the row and column weights of P 
are not constant, P represents the parity-check matrix of an 
irregular LDPC code. If a variable node and a check node 
in the protograph are connected by r parallel edges, then the 
associated entry in P equals r and the corresponding block of 
H consists of a summation of r N x N permutation matrices. 
The sparsity condition of an LDPC parity-check matrix is thus 
satisfied for large N. The code created by applying the copy- 
and-permute operation to an ric x riy protograph parity-check 
matrix P has block length n = Nuy . In addition, the code has 
the same rate and degree distribution for each of its variable 
and check nodes as the underlying protograph code. 



Combinatorial methods of calculating ensemble average 
weight enumerators have been presented in [10] and [15]. The 
remainder of this Section summarizes the methods presented 
in [10]. 

A. Ensemble weight enumerators 

Suppose a protograph contains m variable nodes to be 
transmitted over the channel and Uy — m punctured variable 
nodes. Also, suppose that each of the m transmitted variable 
nodes has an associated weight di, where < di < N for 
all Let Sd = {((ii, (^2, • • • , <^m)} be the set of all possible 
weight distributions such that di -\- . . . -\- dm = d, and let Sp be 
the set of all possible weight distributions for the remaining 
punctured nodes. The ensemble weight enumerator for the 
protograph is then given by 

{dkj^Sd {dj}eSp 

where is the average number of codewords in the ensemble 
with a particular weight distribution d = (di, (i2, • • • , dn^)- 

B. Asymptotic weight enumerators 

The normalized logarithmic asymptotic weight distribu- 
tion of a code ensemble can be written as r{S) = 
limn^cx) sup rn((^), where rn{S) = S = d/n, d is 

the Hamming distance, n is the block length, and Ad is the 
ensemble average weight distribution. 

Suppose the first zero crossing of r{S) occurs at S = Smin- 
If r{S) is negative in the range < ^ < Smin, then Smin is 
called the minimum distance growth rate of the code ensemble. 
By considering the probability 



< Sminn) ^ 



Ad 



it is clear that, as the block length n grows, if ¥{d < 
Smin'n) << 1, then we can say with high probability that the 
majority of codes in the ensemble have a minimum distance 
that grows linearly with n and that the distance growth rate is 

Smin- 

IV. Free distance bounds 

In this section we present a method for obtaining a lower 
bound on the free distance of an ensemble of unterminated, 
asymptotically good, periodically time- varying LDPC convo- 
lutional codes derived from protograph-based LDPC block 
codes. To proceed, we will make use of a family of tail-biting 
LDPC convolutional codes with incremental increases in block 
length. The tail-biting codes will be used as a tool to obtain 
the desired bound on the free distance of the unterminated 
codes. 

A. Tail-biting convolutional codes 

Suppose that we have an ric x riy protograph parity-check 
matrix P, where gcd(nc,n^) = y. We then partition P as a 
y X y block matrix as follows: 



P = 



P 1 P 



^ Since we use copies of the protograph, the weight associated with a 
particular variable node in the protograph can be as large as A^. 



where each block Pij is of size ric/y x Uy/y. P can thus 
be separated into a lower triangular part, Pi, and an upper 
triangular part minus the leading diagonal, Pu . Explicitly, 



Pi 



P2,l 



Pl,2 



Pi,y 



where blank spaces correspond to zeros. This operation is 
called 'cutting' a protograph parity-check matrix. 

Rearranging the positions of these two triangular matrices 
and repeating them indefinitely results in a parity-check matrix 
Hcc of an unterminated, periodically time-varying convolu- 
tional code with constraint length = Uy and period T = y 
given b}|l 

" Pi 
Pu Pi 

Pu Pi 



(4) 



Note that if gcd(nc, riy) = 1, we cannot form a square block 
matrix larger than 1x1 with equal size blocks. In this case. 
Pi = P and Pu is the all zero matrix of size ric x Uy. 
This trivial cut results in a convolutional code with syndrome 
former memory zero, with repeating blocks of the original 
protograph on the leading diagonal. It is necessary in this 
case to create a larger protograph parity-check matrix by 
using the copy and permute operation on P. This results in 
an Mric x Muy = n'^ x parity-check matrix for some 
small integer M. The n'^ x protograph parity-check matrix 
can then be cut following the procedure outlined above. In 
effect, the choice of M x M permutation matrix creates a 
mini ensemble of block codes suitable to be unwrapped to an 
ensemble of convolutional codes. 

We now introduce the notion of tail-biting convolutional 
codes by defining an 'unwrapping factor' A as the number 
of times the sliding convolutional structure is repeated. For 
A > 1, the parity-check matrix H^^"^ of the desired tail-biting 
convolutional code can be written as 



(A) 



Pi 

Pu Pi 
Pu 



Pu 



Note that the tail-biting convolutional code for A = 1 is simply 
the original block code. 

B. A tail-biting LDPC convolutional code ensemble 

Given a protograph parity-check matrix P, we generate 
a family of tail-biting convolutional codes with increasing 
block lengths An^, A = 1,2,..., using the process described 
above. Since tail-biting convolutional codes are themselves 
block codes, we can treat the Tanner graph of H^^^ as a 
protograph for each value of A. Replacing the entries of this 
matrix with either N x N permutation matrices or N x N all 
zero matrices, as discussed in Section [Till creates an ensemble 

^Cutting certain protograph parity-check matrices may result in a smaller 
period T = y' of Hcc, where y' G Z+ divides y without remainder. Ify' = 1 
then the resulting convolutional code is time-invariant. 



of LDPC codes that can be analyzed asymptotically as N goes 
to infinity, where the sparsity condition of an LDPC code is 
satisfied for large N. Each tail-biting LDPC code ensemble, 
in turn, can be unwrapped and repeated indefinitely to form 
an ensemble of unterminated, periodically time- varying LDPC 
convolutional codes with constraint length Ug = Nuy and, in 
general, period T = Xy. 

Intuitively, as A increases, the tail-biting code becomes a 
better representation of the associated unterminated convolu- 
tional code, with A ^ oo corresponding to the unterminated 
convolutional code itself. This is reflected in the weight 
enumerators, and it is shown in Section |V] that increasing A 
provides us with distance growth rates that converge to a lower 
bound on the free distance growth rate of the unterminated 
convolutional code. 

C. A free distance bound 

Tail-biting convolutional codes can be used to establish 
a lower bound on the free distance of an associated un- 
terminated, periodically time-varying convolutional code by 
showing that the free distance of the unterminated code is 
lower bounded by the minimum distance of any of its tail- 
biting versions. A proof can be found in [9]. 

Theorem 1: Consider a rate R = {uy — n^^jny unter- 
minated, periodically time-varying convolutional code with 
decoding constraint length = Nuy and period T = Xy. Let 
dmin be the minimum distance of the associated tail-biting 
convolutional code with length n = XNuy and unwrapping 
factor A > 0. Then the free distance dfree of the untermi- 
nated convolutional code is lower bounded by dmin for any 
unwrapping factor A, i.e.. 



d 



free 



> dr. 



VA > 0. 



(5) 



A trivial corollary of the above theorem is that the minimum 
distance of a protograph-based LDPC block code is a lower 
bound on the free distance of the associated unterminated, 
periodically time- varying LDPC convolutional code. This can 
be observed by setting A = 1. 

D. The free distance growth rate 

One must be careful in comparing the distance growth rates 
of codes with different underlying structures. A fair basis 
for comparison generally requires equating the complexity of 
encoding and/or decoding of the two codes. Traditionally, the 
minimum distance growth rate of block codes is measured 
relative to block length, whereas constraint length is used to 
measure the free distance growth rate of convolutional codes. 
These measures are based on the complexity of decoding 
both types of codes on a trellis. Indeed, the typical number 
of states required to decode a block code on a trellis is 
exponential in the block length, and similarly the number of 
states required to decode a convolutional code is exponential 
in the constraint length. This has been an accepted basis of 
comparing block and convolutional codes for decades, since 
maximum-likelihood decoding can be implemented on a trellis 
for both types of codes. 

The definition of decoding complexity is different, however, 
for LDPC codes. The sparsity of their parity-check matrices, 
along with the iterative message-passing decoding algorithm 
typically employed, implies that the decoding complexity per 



symbol depends on the degree distribution of the variable and 
check nodes and is independent of both the block length and 
the constraint length. The cutting technique we described in 
Section IIV-AI preserves the degree distribution of the under- 
lying LDPC block code, and thus the decoding complexity 
per symbol is the same for the block and convolutional codes 
considered in this paper. 

Also, for randomly constructed LDPC block codes, state-of- 
the-art encoding algorithms require only 0{g) operations per 
symbol, where g « n [16], whereas for LDPC convolutional 
codes, if the parity-check matrix satisfies the conditions listed 
in Section II, the number of encoding operations per symbol 
is only 0(1) [17]. Here again, the encoding complexity per 
symbol is essentially independent of both the block length and 
the constraint length. 

Hence, to compare the distance growth rates of LDPC 
block and convolutional codes, we consider the hardware 
complexity of implementing the encoding and decoding op- 
erations in hardware. Typical hardware storage requirements 
for both LDPC block encoders and decoders are proportional 
to the block length n. The corresponding hardware storage 
requirements for LDPC convolutional encoders and decoders 
are proportional to the decoding constraint length [17]|1 

V. Results and Discussion 
A. Distance growth rate results 

We now present distance growth rate results for several en- 
sembles of rate 1/2 asymptotically good LDPC convolutional 
codes based on protographs. 

Example 1 Consider a (3,6) regular LDPC code with the 
folowing protograph: 




For this example, the minimum distance growth rate is Smin = 
0.023, as originally calculated by Gallager [1]. A family 
of tail-biting LDPC convolutional code ensembles can be 
generated according to the following cut: 



1 1 



1 1 



For each A, the minimum distance growth rate 6min was 
calculated for the tail-biting LDPC convolutional codes using 
the approach outlined in Section IIV-BI The distance growth 
rates for each A are given as 



XNn,, 



Ai^s 



(6) 



The free distance growth rate of the associated rate 1/2 
ensemble of unterminated, periodically time-varying LDPC 
convolutional codes is Sfree = dfree/^^^ as discussed above. 
Then ([5]) gives us the lower bound 



d 



J free 



free 



> 



dn 



(7) 



for A > 1. These growth rates are plotted in Fig. [21 

^For rates other than 1/2, encoding constraint lengths may be preferred to 
decoding constriant lengths. For further details, see [18]. 
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Fig. 2. Distance growth rates for Example 1. 

We observe that, once the unwrapping factor A of the tail- 
biting convolutional codes exceeds 3, the lower bound on 5 free 
levels off at Sfree > 0.086, which agrees with the results 
presented in [8] and [9] and represents a significant increase 
over the value of 5min- In this case, the minimum weight 
codeword in the unterminated convolutional code also appears 
as a codeword in the tail-biting code. 

Example 2 The following irregular protograph is from the 
Repeat Jagged Accumulate [19] (RJA) family. It was shown to 
have a good iterative decoding threshold (7iter = 1.0 dB) while 
maintaining linear minimum distance growth {5min = 0.013). 
We display below the associated P matrix and cut used to 
generate the family of tail-biting LDPC convolutional code 
ensembles. 




2 2 I 1 1 
113 1 



We observe that, as in Example 1, the minimum distance 
growth rates calculated for increasing A provide us with a 
lower bound on the free distance growth rate of the con- 
volutional code ensemble using (|7]). The lower bound was 
calculated as 5 free ^ 0.057 (for A > 5), significantly larger 
than the minimum distance growth rate 5min of the underlying 
block code ensemble. 

Example 3 The following irregular protograph is from the 
Accumulate Repeat Jagged Accumulate family (ARJA) [19]: 




where the undarkened circle represents a punctured variable 
node. This protograph is of significant practical interest, since 
it was shown to have 5min = 0.015 and iterative decoding 
threshold 7iter = 0.628, i.e., pre-coding the protograph of 
Example 2 provides an improvement in both values. 

In this ARJA example, the protograph matrix P is of size 
X = 3 X 5. We observe that gcd(nc,n^) = 1, and 
thus we have the trivial cut mentioned in Section IIV-AI We 
must then copy and permute P to generate a mini ensemble of 
block codes. Results are shown for one particular member of 
the mini ensemble with M = 2, but a change in performance 
can be obtained by varying the particular permutation chosen. 



Increasing A for the chosen permutation results in a lower 
bound, found using (|7]), of Sfree ^ 0.053 for A > 4. Again, 
we observe a significant increase in Sfree compared to 6min- 
B. Simulation results 

Simulation results for LDPC block and convolutional codes 
based on the protograph of Example 3 were obtained assuming 
BPSK modulation and an additive white Gaussian noise chan- 
nel (AWGNC). All decoders were allowed a maximum of 100 
iterations, and the block code decoders employed a syndrome- 
check based stopping rule. As a result of their block structure, 
tail-biting LDPC convolutional codes were decoded using 
standard LDPC block decoders employing a belief-propagation 
decoding algorithm. The LDPC convolutional code, on the 
other hand, was decoded by a sliding-window based belief- 
propagation decoder [4]. The resulting bit error rate (BER) 
performance is shown in Fig|3l 
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Fig. 3. Simulation results for Example 3. 

We note that the protograph-based tail-biting LDPC con- 
volutional codes outperform the underlying protograph-based 
LDPC block code (which can also be seen as a tail-biting code 
with unwrapping factor A = 1). Larger unwrapping factors 
yield improved error performance, eventually approaching the 
performance of the unterminated convolutional code, which 
can be seen as a tail-biting code with an infinitely large 
unwrapping factor. We also note that no error floor is observed 
for the convolutional code, which is expected, since the code 
ensemble is asymptotically good and has a relatively large 
(^/ree ^ 0.053) distance growth rate. 

We also note that the performance of the unterminated 
LDPC convolutional code is consistent with the iterative 
decoding threshold computed for the underlying protograph. 
At a moderate constraint length of 10000, the unterminated 
code achieves 10~^ BER at roughly 0.12 dB away from 
the threshold, and with larger block (constraint) lengths, the 
performance will improve even further. This is expected, 
since both the unterminated and the tail-biting convolutional 
codes preserve the same degree distribution as the underlying 
protograph. 

VL Conclusions 

In this paper, asymptotic methods were used to calcu- 
late a lower bound on the free distance that grows linearly 
with constraint length for several ensembles of unterminated, 
protograph-based periodically time varying LDPC convolu- 
tional codes. It was shown that the free distance growth rates of 



the LDPC convolutional code ensembles exceed the minimum 
distance growth rates of the corresponding LDPC block code 
ensembles. Further, we observed that the performance of the 
LDPC convolutional codes is consistent with the iterative 
decoding thresholds of the underlying protographs. 
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